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Abstract 



I Except the Toeplitz and Hankel matrices, the common patterned matrices for which the limiting 

■ spectral distribution (LSD) are known to exist, share a common property-the number of times each 

(-H I random variable appears in the matrix is (more or less) same across the variables. Thus it seems natural 

to ask what happens to the spectrum of the Toeplitz and Hankel matrices when each entry is scaled by 
the square root of the number of times that entry appears in the matrix instead of the uniform scaling 
by We show that the LSD of these balanced matrices exist and derive integral formulae for the 

moments of the limit distribution. Curiously, it is not clear if these moments define a unique distribution. 



^ ■ Keywords. Large dimensional random matrix, eigenvalues, balanced Toeplitz matrix, balanced Hankel 
lO '• matrix. Moment Method, Bounded Lipschitz metric, Carleman Condition, Almost Sure Convergence, Con- 
^ I vergence in Distribution, Uniform Integrability. 

cn _ 

O I 1 Introduction and main results 

O 

For any (random and symmetric) n x n matrix B, let fii{B), . . . , fin{B) G M denote its eigenvalues 
including multiplicities. Then the empirical spectral distribution (BSD) of B is the (random) distribution 
^ , function on M given by 

H ; 

F"" (x) = n-^#[j : fij{B) G {-oo,x], l<j<n}. 

For a sequence of random n x n matrices {-B,j}n>i if as n — )• oo, the corresponding ESDs F^" converge 
weakly (either almost surely or in probability) to a (nonrandom) distribution F in the space of probability 
measures on M, then F is called the limiting spectral distribution (LSD) of {i?n}n>i- See Bai (1999)11], 
Bose and Sen (2007)|!73 and Bose, Sen and Gangopadhyay (2009)||6l for description of several interesting 
patterned matrices whose LSD exists. Examples include the Wigner, the circulants, the Hankel and the 
Toeplitz matrices. For the Wigner and circulant matrices, the number of times each random variable appears 
in the matrix is (more or less) same across the variables. We may call them balanced matrices. For them, 
the LSD exist after the eigenvalues are scaled by 
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Consider the n x n symmetric Toeplitz and Hankel matrices with an i.i.d. input sequence {xi}. For 
these matrices when scaled by n^^/^, the LSD exists. The Umit is non Gaussian but not much more is 
known about its properties. See Bryc, Dembo and Jiang (2006)|f8l| and Hammond and Miller (2005)191. 
However, these matrices are unbalanced. It seems natural to consider a balanced version of the Toeplitz and 
Hankel matrices where each entry is scaled by the square root of the number of times that entry appears in 
the matrix instead of the uniform scaling by n~^/^. Define the (symmetric) balanced Hankel and Toeplitz 
matrices BHn and i?T„ with input {xj} as follows: 
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Strictly speaking BT^ is not completely balanced, with the main diagonal being unbalanced compared 
to the rest of the matrix but this does not affect the asymptotic behavior of the eigenvalues. We use the 
above version because of the convenience in writing out the calculations later. Figures [U and |2] exhibit the 
simulation results for the BSD of the above matrices. We prove the following theorem. 

Theorem 1. Suppose {xi} are independent mean zero variance one random variables which are either 
uniformly bounded, or are i.i.d. Then almost surely the LSD, say BT and BH of the matrices BTn and 
BHn respectively, exist. 



Remark The limits distributions have unbounded support, are symmetric about zero and have all moments 
finite. The integral formulae for these moments are given in |2.9| and l2. 1 1 H ater in Section 1231 after we develop 
the requisite notation to write them out. Both LSD are non Gaussian and do not depend on the underlying 
distribution of the input sequence. It does not seem to be apparent from our formulae if these moments 
define a distribution uniquely. Establishing further properties of the limits is a difficult problem. 



2 Proof OF Theorem [U 

(1) In Section |2?T] we first show that we may restrict attention to bounded {xi}. 

(2) In Sections 12.21 - 12.41 we develop the trace formula for moments, some related notions and results to 
reduce the number of terms in the trace formula. In Section 12.51 we show that the expected moments of 
the BSD of {BTn] converge. However, it does not seem to be straightforward to show that this limiting 
sequence uniquely determines a distribution. Bven if it did, it is not clear how the convergence of the 
expected moments can be sharpened to convergence of the BSD itself. If we pull out the usual scaling 

the scaling for the («, j)th entry is [1 — lliiij-i/2 whose maximum is n^/^. This unboundedness 
creates problems in the usual argument. 

(3) In Section l2!6l we discuss a known approximation result. 
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(4) Fix any e > 0. Let BT,^ denote the top-left n(l — e) x n(l — e) principal sub-matrix of BTn- The 
Levy distance between F^^" and F^^"- is less than e. Since these truncated matrices are well behaved, 
convergence of F^^" to a non-random distribution BT"^ almost surely, and also the con^esponding expected 
moments follow by the same arguments as for the usual Toeplitz matrices. This limit is uniquely determined 
by its moments. This is done in Section 12771 

(5) In Section 12.81 we show by using results derived in (3) that as e — 0, the spectral measures of BT"^ 
converge to some F^^ and this is the LSD of {BTn}. We finally use a uniform integrability argument to 
conclude that the moments of F^^ are. same as those obtained in (2) above. 

A similar proof works for the balanced Hankel by defining the truncated Hankel matrix obtained deleting 
the first ne/2 and last ne/2 rows and columns from BHn- 



2.1 Reduction to uniform bounded case 

Lemma 1. Suppose for every bounded, mean zero and variance one i.i.d. input sequence {xq, xi, X2, • • •}, 
I^BTnj converges to some non-random distribution F a.s. Then the same limit continues to hold if {xi} is 
i.i.d. with mean zero and variance one. All the above hold for {F^^"}. 

We make use of the bounded Lipschitz metric. It is defined on the space of probability measures as: 

dBiii^, y) = sMj fdfi- I /rfi^: ||/||oo + ||/||l<i} 

where ||/||oo = sup^|/(x)|, = sup^_^j^ - f{y)\/\x - y\. Recall that convergence in dsL 

implies the weak convergence of measures and vice versa. 

We also need the following fact. This Fact is an estimate of the metric distance (i^j^ in terms of trace. A 
proof may be found in Bai and Silverstein (2006)121 or Bai (1999)||I]. 

Fact 1. Suppose A, B are n x 7i symmetric real matrices. Then 

(n \ ^ 71. 

- J2 - MB)\ < - ^{^^{A) - X,iB)f < - Tr(A - B)\ (2.1) 

i=l / i=l 

Proof of Lemma [H For brevity, we deal with only the balanced Toeplitz. Same arguments work for the 
balanced Hankel matrix. For t > 0, define, 

^(t) E[xo{I\xo\ < t)], a\t) Var{xoI{\xo\ < t)) = E[xll\xo\ < t)] - fi{t)\ 
* Xil{\xi\ <t)- n{t) Xi - Xi 



ait) a{t) 



'-, where Xi = Xil{\xi\ > t) + fi{t) = Xi — o-{t)x* 



Let {BT*} be the balanced Toeplitz matrix for the input sequence {x*} and {BT„} be the same for the 
input sequence {xi}. It is cleai^ that {xT} is a bounded, mean zero, variance one i.i.d. sequence. Hence by 
our assumption, F^^" converges to a non-random distribution function F a.s. Using Fact 1, 

< -Tr[iBTn - a{t)BT:f] + -(1 - a{t)fTr[{BT:f]. 
n n 
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Now using strong law of large numbers, we get, 



-Tr[{BT*S] = -E 



y^n-\i- j\ 



1 ™,*2 *2 2 

= i(„x^fL + 2(n-l)x^^ + ... + 2x^' 
n n (n-1) 1 ' 

< -(xf + xf + • • • + 2£;(xS^) = 2. 

n 

Note that, 1 - a{t) — )• as i — )• oo. Similarly, 

iTr[(Sr„-c7(t)i?r:)2] = -Tr[Bfl] 
n n 

= -E 

= l(„x^ + 2(n-l)x-^ + ... + 2x^) 
n n [n — 1) 1 

2 

< + xf + ••• + 2£;[xg] = 1 - 2^(t)2 -o-2(t) ^ ast^oo. 

n 

Hence combining the above ai^guments, we get, limsup^^ dBL{F^'^" , F^'^^) — ^ a.s. as t — )• oo. This 
completes the proof of this Lemma. □ 

2.2 Moment and trace formula 

We need some notation to express the moments of the BSD in a way convenient to further analysis. 

Circuit and vertices: A circuit is any function vr : {0, 1, 2, . . . , /i} — )• {1, 2, . . . , n} such that 7r(0) = 7r(/i). 
Any 7r(i) is a vertex. A circuit depends on h and n but we will suppress this dependence. 

Define two functions and , which we call link functions, and as 

L'^{hj) = \i-j\ and =f + j-l. (2.2) 

Also for L = or L^, as the case may be, define 

Also define the following 

4'Tii,j)=n-\i-j\ and = min(i + j - l,2n - i - j + 1). (2.3) 

(t>T{x,y) = (f>Tix^y) = '^-\x-y\,4>H{x,y) = mm{x + y--,2-x-y + -),^H{x,y) = lim (l)^{x,y) 

n n n— !>oo 

(2.4) 

Finally, for any matrix B, let (ih{B) denote the hth moment of its BSD. Then the trace formula implies 

-Tv[BT^f = ^ y ( W "^^"fe.^.+i) \ V (2.5) 
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1 1 "R 

" ^ n V'/'T(vr(i-l),7rW) 

i=l,2,...,/i 



n n 

vr: TT circuit 



1 1 ^ 

i=l,2,...,h 

Matched circuits: Any value L{'ir{i — 1), ir{i)) is an L value of vr and vr has an edge of order e [1 < e < h) 
if it has an L-value repeated exactly e times. If vr has at least one edge of order one then E(X^) = 0. Thus 
only those vr with all e > 2 are relevant. Such circuits will be said to be matched, vr is pair matched if all its 
edges ai^e of order two. 

Equivalence relation on circuits: Two circuits tti and tt2 are equivalent iff their L-values agree at exactly 
the same pairs That is, iff {L(7ri(z — l),7ri(z)) = L{-Ki{j — l),7ri(j)) 4^ ^(vr2(i — l),7r2(i)) = 

L{TT2{j — 1)) ^(i))} • This defines an equivalence relation between the circuits. 

Words: Equivalence classes may be identified with partitions of {1, 2, • • • ,h}: to any partition we associate 
a word w of length l{w) = h of letters where the first occurrence of each letter is in alphabetical order. For 
example, if ft, = 6, then the partition {{1, 3, 6}, {2, 5}, {4}} is associated with w = abacba. For a word 
w, let w[i] denote the letter in the ith position. The notion of matching and order e edges canies over to 
words. For instance, abacabc is matched, abcadbaa is nonmatched, has edges of order 1, 2 and 4 and the 
corresponding partition is {{1, 4, 7, 8}, {2, 6}, {3}, {5}}. 

Independent vertex: If w[i] is the first occurrence of a letter then 7r{i) is called a independent vertex. We 
make the convention that 7r(0) is also an independent vertex. The other vertices will be called dependent 
vertices. If a word has d distinct letters then there are d + 1 independent vertices. 



2.3 Reduction in the number of terms 

Fix an integer h. Define, 

n^"*" = {vr : vr is matched, of length h and has an edge of order greater than equal to 3}. 

St = ]^ E -u ^ ,A = HorT. 

-■■^^K* n v''AA(7r(i-l),7r(i)) 

i=l 

Lemma 2. 5;f " as n ^ oo for An = Tn or Hn. Hence, only pair matched circuits are relevant while 
calculating lim£'(/3ft(j4„)). 

Proof. We provide the proof only for T„. Proof for Hn is similar and details are omitted. Note that, 



lb 



" " nti ^/n-\^:{^-\)-l^{i 



It is enough to prove that for each w, Sh,w — ^ 0. We first restrict attention to w which have only one edge 
of order 3 and all other edges of order 2. Note that this forces h to be odd. Let h = 2t + I and \w\ = t. 
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Fix the L-values at say ki,k2, ■ ■ ■ ,kt where ki is the L- value con^esponding to the order 3 edge and let 
zq be such that L{7r{iQ — l),7r(io)) = ^i- We start counting the number of possible tt's from the edge 
(7r(io — 1), 7r(io)). Clearly the number of possible choices of that edge is at most 2{n — ki). Having chosen 
the vertex zq, number of possible choices of the vertex [iq + 1) is at most 2. Carrying on with this argument, 
we may conclude that the total number of tt's having L values /ci, /c2, . . . , fct is at most C x (n — ki). Hence 
for some generic constant C, 

s...-- E E \ £ - E "'^ 

fcie{o,i,.--,«-i} (n - /ci)2 J] (n - h) fci6{o,i,.. ■,«-!} (n - ki)^ Y\ [n - ki) 

= 0(v/^)0((l°«")'-)^o'J„^^. 

n 

In the last step, we have used the facts that J2k=i I = 0(log n) and for < s < 1, Ylk=i = Oin^^"). 
It is easy to see that when w contains more than one edge of order 3 or more, the order of the sum will be 
even smaller. This completes the proof of the first part. The second part is immediate since E{XTr ) = 1 for 
every pair matched circuit and E'dXTrl) < oo uniformly over all tt. □ 



2.4 Slope in balanced Toeplitz matrices 

Since the Toeplitz matrices have link function L{i, j) = \i — j\, given an L- value and a vertex there are at 
most two possible choices of the other vertex. Bryc, Dembo and Jiang (2006)|f8l| showed that out of these 
two possible choices of vertices only one choice counts in the limit. We show now that the same is true for 
the balanced matrices. Let 

Ilh,+ = {vrpair matched : there exists at least one pair (io; Jo) with 7r(io— 1)— 7r(io)+vr(jo— 1)— 7r(jo) 7^ 0}, 
Define Ilh,+ {'^) = ^h,+ H Il{w) and let 7r(i — 1) — 7T{i) be i^^ slope value. 

Lemma 3. Let vr E Ilh+ <^nd ki,k2, ■ ■ ■ ,kfibe the L-values ofir. Then 3 jo G {1,2,... ,h} such that kj^ = 
A{ki, k2, ■ ■ ■ , kjg^i, fejo+i) ■ ■ ■ ' ^h)for some linear function A. 

Proof. We note that sum of all the slope-values of vr is zero. Now sum of slope-values from matched pair 
is if the L values are of opposite sign and 2kj or —2kj if the L values are of same sign. Hence we have, 
f{ki,k2,---,kh) = for some linear function / where coefficient of kj = if L values con^esponding to 
kj are. of opposite sign and it is ±2 if L values corresponding to kj are of same sign and the slope-values 
are positive (negative). Since vr G ^h,+, 3 /cj 7^ such that L-values corresponding to j*'* pair have same 
sign. Let 

{ii, ^2, . . . ,ii} = {j : coefficient of kj / 0} and jo = max{j : coefficient of kj / 0}. 
Then kj^ can be expressed as a linear combination /cj^, = A{ki-^ ,ki^,...,ki^). □ 

def 1 

Lemma 4. S^^ = ^ 2. — h 7^^^^^^^^^^^^ — a^' n — t- 00. Hence, to calculate 

''nm^,+ Ui=i A/n-|7r(i-l)-7r(i)| 

lim E(f5h(BTn)) we may restrict attention to pair matched circuits where each edge has oppositely signed 
L-value. 
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Proof. As in Lemma|2j write Sh+ = Sh+^w where Sh+,w is the sum restricted to vr e Ilh^^{w). Enough 
to show that this tends to zero for each w. Let the corresponding L values to this whe ki,k2, ■ ■ ■ ,kh- Hence, 

_ 1 of TT e Ilh+{w) 3 L values of TT are {/ci, A;2, /c/j}) 



e{0,i,2,...,n-i} YYv^-i^i) 



1=1 

For this fixed set of L values, there are at most 2^'^ sets of slope-values. It is enough to prove the result for 
any one such set. Now we start counting the number of possible vr's having those slope values. 

By the previous lemma there exists jo such that kj^^ = A(fej^, ki^, . . . , ki^). We start counting number of 
possible TT from the edge corresponding to the L value /cjq, say, (7r(i* — 1), 7r(z*)). Clearly number of ways 
to choose vertices 7r(i* — 1) and 7r(i*) is (n — kj^^). Having chosen 7r(i*), there is only one choice of 7r(z* + 1) 
(since the slope-values have been fixed). We continue this procedure to choose all the vertices of the circuit 
TT and hence number of tt's having the fixed set of slope- values is at most (n — kj^ ). Note that since w and 
the slope signs are fixed, the linear function A and the index jo are determined as well. Thus for that fixed 
set we have, 

' r) ^ — ^ IT''' U \ r) I ^ 



" fc,e{o,i,2,...,n-i} Ui=iin - ki) n Jl -i " 



As fejp = A{kij^,ki2, . . . , /cjj, in the above sum, kj^ should be kept fixed which implies that Sh+,w < 

O f (log n) ''"-'-') 

— — — )• as n — )• oo, proving the first part. The second part now follows immediately. □ 

2.5 Convergence of the moments E [/3h{BTn)] and E [PhiBHn)] 

We need first establish a few results on moments of truncated uniform. For a given random variable X (to 
be chosen), define (whenever it is finite) 

Lemma 5. Let x G Nn = {^/n, 2/n, ...,!}, a > and X be discrete uniform on Nn. Then, for some 
constants Ci , C2, 

max{(7r(2;),5//(x)} < Cix^" + C2(l -x + l/n)"" + 1/n. 

Proof. Note that 

1 ^ 1 - ^ V ^ Iv^^^— - 

9y^' ~ \l-\x- ~ (I - tzy)i+^ ^ (I - a:ii)i+^ ~^ n' 

y=l ' y^j \^ n ' y>j ^ n ' 

where x = j /n and 1 < j < n. For j = 1 orn similar arguments will go through. Now, 
n n ^ 

y<j t=l t=n-j+l 

Ci 



^ ^"^7 ^^-^ = Ci{l-x + l/n) 

(n - J + 1)" 



By similar ai-guments, i ^ M^aiiu+c. ^ ^'22; °. 

y>j ^ " ' 

By similar calculations gnix) < Cix~° + C2(l — x + l/n)~" + 1/n and thus the result follows. 
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Lemma 6. Suppose Ui^n <ire i.i.d. discrete uniform on 'Hn- l-^t Oj G 1 < i < ?n be fixed and < /3 < 1. 

m 

Let, Yn= Yli o-iUi,n and Zn = 1 — Yn + 1/n. Then 

i=l 

supE|y„|-^I(|y„| > l/n) + supE|Z„r^/(|Z„| > 1/n) < oo. 

n n 

Proof. First note that 

m 

^{\Yn\ < M/n) = E [p( - M/n <Y,^^U^,n < M/n^Ui^^J + «o)] 

m m 

- M/n - J2 (^iU^,n < a»of^io,n < M/n - ^ a,;7i,„)j < (2M + 1)/ 



E 



n. 



1=1 1=1 



Let Ui,U2, ■ ■ ■ , Um be m i.i.d U (0, 1) random variables. We note that, 

V ( \nU{\ \nU2\ \nU„ 



^ Ul^n, U2,n, ■ ■ ■ 

Define 



? 5 • • • 5 

n n n 



m 



Then, 



r rri 

X — ^ \ — ^ X — ^ 

Yn = 2_^ai , Y = 2_^aiUi and K = 2_^\ai\. 

1=1 i=l 1=1 

Yn = Yn and \Yn-Y\<K/n. 

E |y„|-'^/(|y„| > 1/n) = E |y„|-^/(l/n < \Yn\ < 2K/n) + E |y„|-^/(|y„| > 2K/ 

< n^ ^^ + ^ + E(|y| - K/n)-'^I{\Y„\ > 2K/n) 
n 



n) 



< o{l)+E{\Y\- K/n)-^I{\Y\> K/n) 

< o(l)+ / {x- K/n)-^fiY\ix)dx. 

Jx>K/n 



lx>K/n 

Now, 

/ {x-K/n)-^f\Y\[x)dx= I x-^f\Y\{x + K/n)dx. 

Jx>K/n Jo 

It is easy to see that fy vanishes outside [—K, K]. Using induction one can also prove that, /y (x) < 1 V x. 
These two facts yields, 

POO j-K+K/n 

I x-^f\Y\{x + K/n)dx< I x-^2dx = 0{l). 

Jo Jo 

Hence, 

supE|y,|-^I(|y„| > 1/n) <oo. 

n 

The proof of the finiteness of the other supremum is similar and we omit the details. □ 

Lemma 7. Suppose {x,} are i.i.d. bounded with mean zero and variance 1. Then lim E[/3/i (i?T„)] and 
FilfShiBHn)] exists for every h. 
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Proof. From Lemma |2] it follows that E[f32k+i{BA„ 
Lemma|2]and Lemma|4](if limit exists) we have, 



as ?i — )• oo where Ar. 



T„ or Hr,. From 



lim E[f32k{BTn)] 



w pair matched 

E 



Eiim — 

7ren*(w) 

- E 



EX. 



lim 

w pair matched ttSII** (lo) 



nil V<^r(vr(z-l),7r(i)) 
1 

nil -^i;^ 



where n**(ti;) = {vr : = w[j] =^ 7r(z — 1) — vr(i) + 7r{j — 1) — 7r(j) = 0}. Denote Xi = 7r{i)/n. Let 
5 = {0} U {min(i, j) : w[i] = w[j] ,i 7^ j} be the set of all independent vertices of the word w and let = 
{xi : i S}. Each can be expressed as a unique linear combination LJ{xs)- LJ depends on word w but 
for notational convenience we suppress its dependence. Note that LJ{xs) = for i S S and also summing 
k equations we get L^^^ixs) = xq. If w[i] = w[j] then |L^i(x5) - Lf{xs)\ = \LJ^i{xs) - LJ{xs)\- 
Thus using this equality and proceeding as in Bose and Sen f7| and [BDJ] |f8l| we have, 



lim E[/32k{BTn) 



V lim E 

to pair matched 



I{Ll{Un,s)^^n,i^Su{2k}) 
ies\{o} 



where for each i G 5, Un,i is discrete uniform on N„, and Un,s is the random vector on R'^^^ whose 
co-ordinates are C/„ j and Un/s ai^e independent of each other. We claim that 



lim E[P2k{BTn)] =m^k= Y] 

w pair matched 



T 



E E 

w pair matched 



I{Lf{Us)e{0,l),i^Su{2k}) 

ies\{o} 



(2.9) 

where for each z G 5, ~ [7(0, 1) and Us is a ]R^+^ dimensional random vector whose co-ordinates are 
Ui and they are independent of each other. Note that to prove (??) it is enough to show that for each pair 
matched word w and for each k there exists ak > such that 



sup E 



n 0J(Li_i(C/„,5),C/.)) J 
ies\{o} 



< 00 



(2.10) 



We will prove that for each pair matched word w 



sup E 



I{Lj {Un,s) £ Nn,i ^ SU{2k},i < max 5) 

ie5\{0} 



< 00 



and we prove it by induction on k. For k = 1 the expression reduces to E 



1 



1+a 



Now, 



E 



1 - \U, 



n,0 



UuaI 









= E 



E 



{(r 



1+0 



n,o| 



Unfl — Un,l\ 

EbT(f/n,o)] < Ci E[U-^] + C2 E[(l - C/„,o)^"] + 1/n by Lemma[5]. 



Now by Lemma[6]we have, sup E 



1 



i-|r/n,o-c/„,i| 



1+a 



<oo V 0<a<l. 
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Now we assume the result for A; = 1,2, ... ,t. We prove it for A; = t + 1. Fix any pair matched word wq. 
Note that the random variable coiTesponding to the generating vertex of the last letter appears only once and 
hence we can do the following calculations. Let 



Bt 



+1 



l[Lj{Un,s) G N„, i ^ 5 U {2{t + < maxS 

n {l-\Ll,iUn,s)-UnA) ^ 

ies\{o} 



1+a 



Then 



E 



E 



/l(LjiUn,s) enn,i(^S,i< maxS\{it+i} 



l+a 



n {l-\Ll,{Un,s)-Un 

ies\{o,it+i} 



By Lemma[5]and Lemma|6l sup ||^'n||g < oo whenever aq < 1. Here || • denotes the Lq norm. 

n 

Let us now consider the word Wq obtained from wq by removing both occurrences of the last used letter. 
We note that the quantity is the candidate for the expectation expression corresponding to the word Wq. 
Now by induction hypothesis, 3 ot > such that, 



sup E 



\ n {l-\Ll{Un,s)-UnA) 

i6S\{0,jt+i} 



< oo. 



Hence sup ||$n||p < co if, (1 + q)p < (1 + at). Therefore 

n 

at+1 + "^'^^ < 1 + 1 = 1 ^ supE[$„1'„] < sup||$„||p||*n||g < oo. 
l + at p q n n 

This proves the claim for balanced Toeplitz matrix. For balanced Hankel matrix we again use Lemma|5]and 
Lemma [6] and proceed in an exact similar way to get. 



lim E[/32A:(5i/„)] =mffc 
n— ^oo 



I(Lf([/5) G (0,1), i i SU{2k] 



^ '^^''^ ^ V n ^'^{Li^i{Us),Ui)) 

^ pair matched -u; pair matched . ^ ^\ 'J n i' J / 

and symmetric and symmetric x^Uj 

(2.11) 

Symmetric pair matched words are those in which every letter appears once each in an odd position and 
an even position. Using ideas of Bose and Sen (2008) Q and [BDJ] [U it can be shown that for any pair 
matched non-symmetric word w, ^ = 0. So the above summation is taken over only pair matched 
symmetric words. □ 



2.6 An approximation result 

Even though the limit of the moments have been established, it does not seem to be easy to show that tiiis 
moment sequence determines a probability distribution uniquely (which would then be the candidate LSD). 
We tackle this issue by using approximating matrices whose scalings ai^e not unbounded. We shall use the 
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Levy distance metric to develop this approximation. Recall that this metric metrizes weak convergence of 
probability measures on M. Let fii, i = 1, 2be two probability measures on M. The Levy distance between 
them is given by, 

p(^fi,^2) = inf{e > : Fi{x - e) - e < F2{x) < Fi{x + e) + e, V 2; G M}, 

where Fi i = 1,2 are the distribution functions corresponding to the measures /ij, i = 1,2. 

Proposition 1. (Bhamidi, Evans and Sen (2009)) Suppose Anxn is real symmetric matrix and Bmxm is the 
principal sub-matrix of Anxn- Then 

p{F^,F^)< (--l) Al. 

Let (^fc)fcLi ^ sequence of real symmetric matrices. For each e > 0, and each k, let (S^)^^ be an n| x 
n| principal sub-matrix of A^. Suppose that for each e > 0, F^ = lim F^k exists and limsupnfc/n| < 

fc— !>oo fc— >co 

1 + £. Then F^o = lim F^''- exists and is given by F^o = lim F^. 

fc— >oo eXO 

Consider the principal submatrix BT^ of BTn obtained by retaining the first n(l — e) rows and columns 
of BTn- Then for this matrix, since |i — i| < n{l — e), the balancing factor becomes bounded. We shall 
show that LSD of {F^^"-} exists for every e and then invoke the above result to obtain the LSD of {F^^"-}. 
Similar argument holds for {BHn}, by considering the principal sub-matrix obtained by removing the first 
ne/2 and last ne/2 rows and columns. 



2.7 Existence of limit of {F^^™ } and {F^^" } almost surely 



Clearly, for any fixed e > 0, we may write. 



n 



n 



n - |7r(« - 1) - 7r(i) 

i=l,2,...,/i 



n 



1=1,2,. 



■nii) < nil — e] 



(2.12) 



And similarly. 



I ne/2 < 7r(i) < n(l-e/2) 



(2.13) 



Since for every e > 0, the scaling is bounded, the proof of the following Lemma is exactly as the proof of 
Lemma 1 and Theorem 6 of Bose and Sen (2008) Q. Hence we skip the proof. 

Lemma 8. (i) Ifh is odd E[(3h{BT^)] and E[^h{BH^)] 0. 

( ii) If h is even (= 2k), then (below the sums are over all pair matched w) 



lim E[Pf,{BT^)] = y^pBT4w) 



1-e 



1-e . 



n KO<Lfixs)<l-e 



i<^SU{2k} 



k+1 



n (i-iLf_i(x5)-x.i) 

^ ies\{o} 



-dxs = l32k say 



lim E{l3h{BH'J] = y^pBH 



l-e/2 
e/2 



l-e/2 



e/2 



n l{e/2<Lf{xs)<l-e/2) 



i^SU{2fc} 



fc+1 



j65\{0} 



-dxs = l^2k ^^y- 
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Further, max{/3^ , /3||^} < x e ^. Hence there exists unique probability distributions F'^^ and F^^ 
with /3^^ and (3^^ (respectively) as their moments. 

The almost sure convergence of {F^^" } and {F^^" } now follows from the following Lemma. We omit 
its proof since it is essentially a repetition of arguments Proposition 4.3 and Proposition 4.9 of[BDJ] who 
established it for the usual Toeplitz matrix T„ and usual Hankel matrix Hn- 

Lemma 9. Fix any e > and let An = or Hn- If the input sequence is uniformly bounded, independent, 
with mean zero and variance one then 



- TilBAif - E i TiiBAif 
n n 



E 

As a consequence, the BSD ofBAf^ converges to F^" almost surely. 



0[\]. (2.14) 



2.8 Connecting limits of BT^ and BTn 

From Lemma[8]and Lemma|9l given any e > 0, there exists Be such that P(i?e) = 1 and on Be, F^^^ 
F^\ 

Fix any sequence {em}m=i decreasing to 0. Define B = HBe^ . Using Proposition [T] on B, F^^" 
for some non-random distribution function where, is the weak limit of {F-^ ^ }m=i- 

Let X^'" (resp. X) be a random variable with distribution F-^ (resp. F^) with kth moments /Sj^" 
(resp. /5j). From Lemma [8j and ( |2.9b it is clear that for all k > 1, 



lim = and lim /jjfc" = mffc = V 



T 

ui pair matched 



From Lemma|71 m^^, is finite for every k. Hence {(X^™)'^}^^]^ is uniformly integrable for every k and 
lim /Sj^™ = /3^. This proves that = and so {rnj^} are the moments of F^. The argument for 
BHn is exactly same and hence details are omitted. The proof of Theorem [T] is now complete. □ 

Acknowledgement. We learnt the idea of the truncation that we have used, from personal communication 
with Amab Sen who credits them to Steven Evans. 
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Figure 1: Histograms of the ESD of 15 realizations of the Toeplitz matrix (left) and the balanced Toeplitz matrix 
(right) of order 400 with standardized Normal(0, 1) (top row), and Bernoulli(0.5) (bottom row) entries. 
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Figure 2: Histograms of the ESD of 15 realizations of the Hankel matrix (left) and the balanced Hankel matrix (right) 
of order 400 with standardized Normal(0, 1) (top row), and Bernoulli (0.5) (bottom row) entries. 
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